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(54) DIGITAL CAMERA HAVING IMAGE PROCESSING FUNCTION 

(57)Abstract 

PROBLEM TO BE SOLVED: To provide a digital camera 
having an image processing function that eliminates the 
need for a sensor detecting any physical quantity for 
correction factors such as camera-shake so as to obtain 
an excellent image. 

SOLUTION: The digital camera having the image 
processing function that corrects an image and provided 
with a storage device 101 that stores a picked— up image 
and a display device 104 that displays the image, is 
provided with an image processing means 102 that 
corrects the picked-up image, and an operation means 
103 that gives correction information to the processing 
means. The operation means is characteristically 
configured that is operated externally and the operation 
means properly provides correction information to the 
picked-up image to correct the image on the basis of 
the image that is displayed on the display device and 
picked up. 
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JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CUMMS 



[Claim(s)] 

[Claim 1]Memory storage which memorizes a picturized picture. 
A display which displays said picture. 

An image processing means which amends a picture which is a digital camera with an image 
processing function provided with the above, and was picturized, It has a control means which 
gives correction information to this image processing means, this control means is constituted 
operational from the exterior, said control means gives correction information suitably based on 
a picturized picture which was displayed on said display, and a picture is amended. 

[Claim 2]A digital camera with the image processing function according to claim 1 using the 
deteriorated image restoration technique by the blind deconvolution method as said image 
processing function. 

[Claim 3]A digital camera characterized by comprising the following with the image processing 
function according to claim 1. 

An amendment previous image storage means said memory storage remembers a picture before 
amendment to be. 

An aftei^amendment image storing means which memorizes a picture after amendment. 

[Claim 4]A digital camera with the image processing function according to claim 1, wherein said 
memory storage constitutes said past record usable by said control means while being provided 
with an image-correction-information memory measure which memorizes a past record of image 
correction information. 



[Translation done.] 
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JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention]This invention relates to a digital camera with the image processing 
function which added the restoration function of the picture in which it deteriorated by the 
shaking hand or focal gap, etc. 
[0002] 

[Description of the Prior Art]Although various mechanisms which amend degradation of the 
picture by the shaking hand in a digital camera, etc. from before are proposed, For example, as 
shown in drawing 7 , although it changes with techniques of amending a shaking hand, the image 
pick-up part 500 which comprises photo detectors of a lens etc., such as an optical system and 
CCD, includes the mechanical mechanism which amends vibration of an optical system, or the 
arithmetic circuit which changes the pixel information of CCD, and is constituted. 
[0003]According to this conventional technology, when producing vibration to a camera by a 
shaking hand etc. at the time of photography, the vibration detecting sensor 501 detects the 
vibrating amount. By the oscillating correcting operation circuit 502, detected vibration computes 
a camera's own motion vector, and calculates correction value. Degradation of pictures, such as 
a shaking hand, is prevented or amended by amending an optical system mechanically or 
amending the value of each pixel of a photo detector by image processing arithmetic based on 
the correction value. The picture made finishing [ hand shake correction ] as a result is recorded 
on the recording medium 101 which comprises a flash memory, a hard disk, etc., for example. 
[0004]As for each of these conventional technologies, the following two characteristic elements 
are included. 

(1) Use the sensor which detects a certain physical quantity to amendment factors, such as a 
shaking hand. 

(2) When amendment of a shaking hand etc. is required, a certain compensation means amends 
and the picture after the amendment is recorded on a recording medium. 

[0005] 

[Problem(s) to be Solved by the Invention]According to this conventional technology, there are 
the following technical problems in the technique of amending degradation of the picture by the 
shaking hand in a digital camera, etc. conventionally from the above point. 

O Need the sensor which detects a certain physical quantity to amendment factors, such as a 
shaking hand. 

O When the exact correction amount is not obtained to amendment of a shaking hand etc., the 
picture of mistaken correction results is recorded on a recording medium. 
[0006]In light of the above-mentioned problems, this invention is a thing. 

The purpose is to provide the digital camera which has an image processing function which can 
make unnecessary the sensor which detects a certain physical quantity to an amendment factor, 
and can acquire a good picture. 

Other purposes of this invention are to prevent mistaken correction results from being recorded 

on a recording medium. 

[0007] 

[The means for making a technical problem solved] In a digital camera with the image processing 
function which amends said picture while this invention is provided with the memory storage 
which memorizes the picturized picture, and the display which displays said picture, It has an 
image processing means which amends the picturized picture, and a control means which gives 
correction information to this image processing means, this control means is constituted 
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operational from the exterior, said control means gives correction information suitably based on 
the picturized picture which was displayed on said display, and a picture is amended. 
[0008]And it is desirable to use the deteriorated image restoration technique by the blind 
deconvolution method as said image processing function. According to this art, the control 
means which gives correction information to the image processing means which amends the 
picturized picture is constituted operational from the exterior, Since said control means gave 
correction information suitably and the picture is amended based on the picturized picture which 
was displayed on said display, it is not necessary to form the mechanism in which the amount of 
Bure is automatically detected to a shaking hand picture, and a shaking hand picture or a pin 
dotage picture can be amended with easy composition. 

[0009]Since the mechanism in which the amount of Bure is detected automatically is not used, it 
can amend in accordance with the photographic subject image which an operator usually 
picturizes, and the picture of mistaken correction results can be prevented from being recorded 
on a recording medium. 

[0010]Since it has an image processing function by the deteriorated image restoration technique 
by the blind deconvolution method, Even if it does not use the image restoration processing by 
computers, such as a personal computer, an output of the good picture which set said image 
recording medium in the external output unit etc. directly, and restored the shaking hand etc. is 
possible by using the image recording medium after processing as a removable recording medium 
etc. 

[001l]Said memory storage is a means in which this invention of having and constituting the 
amendment previous image storage means which memorizes the picture before amendment, and 
the after-amendment image storing means which memorizes the picture after amendment is also 
effective. In order to have a recording medium which records both the picture before the 
amendment which is a raw picture, and the after-amendment picture after image processing to 
the picture to photo according to this arts means, Since the amendment from which the 
amendment beyond it deviated from the raw picture to the degree very much impossible can be 
prevented even if it is measurement of the imperfect amount of Bure when the amount of Bure 
is automatically measured and amended like conventional technology, record of the picture of 
imperfect correction results can be prevented. 

[0012]Said memory storage is a means in which it is also effective to constitute said past record 
usable by said control means as for this invention while being provided with the image- 
correction-information memory measure which memorizes the past record of image correction 
information. 

[0013]According to this arts means, the past record of the image correction information used as 
a degradation factor is recorded suitably, When reading and carrying out restoration processing 
of another picture which deteriorated, what was suitable from this past record data currently 
recorded can be chosen and used, and it has an effect which makes it possible to shorten 
deteriorated image restoration processing time. 
[0014] 

[Embodiment of the Invention]Hereafter, based on a drawing, an embodiment of the invention is 
described in detail in illustration. However, the size of the component parts indicated to this 
embodiment, construction material, shape, its relative configuration, etc. are not the meaning 
that limits the scope of this invention only to it but only mere examples of explanation, as long 
as there is no specific statement in particular. 

[001 5]The lineblock diagram of the digital camera which has an image processing function which 
drawing 1 requires for a 1st embodiment of this invention, and drawing 2 , The figure showing the 
image restoration algorithm by the Fourier repeating method which is the contents of the image 
processing function concerning an embodiment of the invention, and drawing 3 . The model figure 
of non-negative conditions of the image restoration algorithm by the Fourier repeating method 
and drawing 4 , The schematic diagram of data processing of the image-processing-arithmetic 
circuit which requires the lineblock diagram of the image-processing-arithmetic circuit 
concerning an embodiment of the invention and drawing 5 f or an embodiment of the invention, 
and drawing 6 are the lineblock diagrams of the digital camera which has an image processing 
function concerning a 2nd embodiment of this invention. 

[0016]In drawing 1, the image pick-up part 100 comprises photo detectors, such as optical 
systems, such as lens **, and CCD. Although the raw picture before amendment is recorded and 
the recording medium 101 which records the picture information received in the image pick-up 
part 100 comprises a flash memory, a hard disk etc. may be sufficient as it. The image output 
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part 104 which can observe the picture recorded on this recording medium 101 comprises a 
liquid crystal display means. 

[0017]The image-processing-arithmetic circuit 102 has a function of the deteriorated image 
restoration technique (for example, the image restoration technique by the Fourier repeating 
method) by the blind deconvolution method, and comprises an arithmetic image storage memory, 
the Fourier conversion circuit, a four^operations circuit, etc., for example. The deteriorated 
image restoration technique by this blind deconvolution method, (For example, it is the image 
restoration technique by the Fourier repeating method announced by literature (G. RAyers and 
J.C.Dainty, OptLett. 13, 547-549 [1988]) etc., and) It is the technique of separating the image 
restoration which has not deteriorated, and a degradation factor only based on the information 
on a deteriorated image. 

[0018]The alter operation part 103 comprises switches, a touch panel, etc., and when an 
observer judges that it has deteriorated by the shaking hand etc. to the picture observed by the 
image output part 1 04, operation of starting and suspending the restoration processing of a 
picture is constituted possible. The processing image recording medium 105 is a recording 
medium which records the processing picture which performed restoration processing in the 
image-processing-arithmetic circuit 102. 

[0019]Here, the image restoration technique by the Fourier repeating method is explained as the 
restoration technique of the deteriorated image by the blind deconvolution method. The 
deteriorated image by a shaking hand etc. is as follows in expression, and it is expressed. 
[Equation 1] 



c(x, y): The dotage picture for restoration, the original image which is not f(xi, eta): Fading, g (x- 
xi, y-eta): The point response function leading to dotage [0020]The dotage picture c is 
expressed with the convolution (convolution) of the original image f and the point response 
function g in a formula (1). If the Fourier transform of c, f, and g is expressed with C, F, and G, 
respectively, in a spatial frequency domain (Fourier transformation plane), it is C(mu, nu) =F(mu, 
nu) -G (mu, nu)... (2) 
It can express. 

[0021]To a dotage picture which is expressed with a formula (1) or a formula (2), when the 
dotage picture c and the point response function g are known, restoration of the original image f 
can be performed more easily than a following formula. 
F(mu, nu) =C(mu, nu)/G (mu, nu) (3) 

[0022] However, there are few examples which the point response function g understands 
correctly in the restoration processing of a picture, and only the dotage picture c made 
applicable to restoration is known in many cases. The restoration processing by a formula (3) is a 
technique which is called a deconvolution and is widely used for signal processing not only image 
processing but at large. On the other hand, the technique which presumes F in a formula (2) and 
G and is separated from the dotage picture c is called the blind deconvolution method. 
[0023]The amendment of deteriorated images, such as a shaking hand, in conventional 
technology is exactly detecting the value of this G (mu, upsilon) using a various sensor, and 
performing the deconvolution by a formula (3). However, the deteriorated image restoration 
technique by the blind deconvolution method in this embodiment is a technique converged on the 
relation with which presumes said f and g, repeated calculation is performed, and it is satisfied of 
a formula (2), fading on the display of a liquid crystal and gazing at the picture c so that it may 
mention later. 

[0024]The algorithm of the image restoration technique by this Fourier repeating method is 
shown in drawing 2 . In drawing 2 , Fourier transform [ of the presumed original image f, the 
presumed point response function g, the initial original image fO, and a dotage picture ] C, It is 
referred to as Fourier transform [ of a presumed original image ] F, and Fourier transform G of a 
presumed point response function, and The presumed original image f, and Fourier transform [ of 
the presumed point response function g ] F and G, It converges on the relation of F and G which 
are satisfied with performing repeated calculation, giving non-negative conditions (Step 4) and 
(Step 8) to [ the deconvolution (Step 6) and there ] which are the restoration processing shown 
in inverse Fourier transform (Step 3), (Step 7), and the formula (3) which return them of a 
formula (2). 
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[0025]Non-negative conditions mean the work which changes the value into a positive value, 
when an impossible negative value originally appears in each pixel of the picture information f and 
g obtained within repeated calculation. Drawing 3 models this non-negative condition. A 
horizontal axis is each picture element position (for example, position of each light sensing 
portion to that to which the light sensing portion has aligned like a CCD camera at two- 
dimensional matrix form.). In order to explain simply, in a certain vertical axis, a light sensing 
portion expresses luminous intensity with drawing 3 along with a single tier. 
[0026]The picture information from which drawing 3 (a) produced the negative value in repeated 
calculation shows signs that drawing 3 (b) changes a negative value into a positive value as non- 
negative conditions. As conditions changed into a positive value, the total law of conservation of 
energy needs to be realized before and behind non-negative conditions. Here, the work which 
divides total of the total amount of energy which produced the negative value by the pixel 
number of the whole picture, averages it, for example, and is added to each pixel is shown. 
[0027]Next, an operation and an effect are explained about a 1st embodiment using drawing 1 . 
The picture information received in the image pick-up part 100 which comprises photo detectors 
of a lens etc., such as an optical system and CCD, is recorded on the recording medium 101. The 
picture recorded on the recording medium 101 is observed with the liquid crystal panel of the 
image output part 104. Here, the picture recorded on the recording medium 101 is recorded as a 
picture which deteriorated, even when degradation factors, such as a shaking hand, exist. 
[0028]When an observer judges that it has deteriorated by the shaking hand etc. to the picture 
observed by the image output part 104, operation of image restoration is performed using 
switches, a touch panel, etc. in the alter operation part 103. Restoration processing of the 
deteriorated image by the blind deconvolution method is performed by repeated calculation as 
shown in drawing 2 , as mentioned above. Setting [ (for the Fourier transform of the point 
response function with which C becomes the Fourier transform of a deteriorated image, F 
becomes the Fourier transform of an original image, and G becomes a degradation factor to be 
expressed) ] in this repeated calculation, C is known in the deteriorated image obtained. [ C=FG 
of a formula (2), and ] In order to start repeated calculation, the initial value of F or G is 
presumed. Usually, since it is completely strange, F and G use a random number as an initial 
value. Here, an initial value is set to F of a random number, for example. G to this initial value is 
called for from the relation of a formula (2). A non-negative constraint as shown in drawing 3 is 
given to this G, and it is considered as the thing nearer to a correct answer. It asks for F from 
the relation of a formula (2) using G approaching this correct answer. A non-negative constraint 
is given to this F as well as G, and it is considered as the thing nearer to a correct answer. By 
repeating this operation by repeated calculation, F and G approach the correct answer. 
[0029]The restoration technique of the deteriorated image by the blind deconvolution method, In 
order to perform convergence processing by repeated calculation, a restoration degree reaches 
default value or the appearance of image restoration is observed one by one by the image output 
part 104, and when an observer judges that it is enough, by the alter operation part 103, 
restoration processing is stopped and it records on the processing image recording medium 105. 
Of course, when the picture recorded on the recording medium 101 is judged that in the state 
observed by the image output part 104 may be sufficient, it can record on the processing image 
recording medium 105, without performing restoration processing of a picture. 
[0030]Here, drawing 4 explains the composition of the image-processing-arithmetic circuit 102 in 
this embodiment. The image-processing-arithmetic circuit 1 02 inputs the deteriorated image by 
dotage etc., has a function which outputs the image restoration which removed the degradation 
factor, and restores the deteriorated image by the blind deconvolution methods, such as an 
image restoration algorithm by the Fourier repeating method of drawing 2 . 
[0031 ]The arithmetic circuit 600 where the image-processing-arithmetic circuit 102 performs 
the Fourier transform and four operations, It comprises the arithmetic image storage memory 
601 which memorizes the Fourier transform information on a dotage picture, the presumed image 
restoration information updated by the restoration processing process each time, the presumed 
point response function information used as a degradation factor, the Fourier transform 
information on presumed image restoration, the Fourier transform information on a presumed 
point response function, etc. 

[0032]The presumed point response function information used as a degradation factor is the 
same picture information as presumed image restoration information here, and each picture 
information is two-dimensional luminous-intensity information, and is general picture information 
as which luminous-intensity information is expressed by the matrix form of a number of 
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horizontal picture elements x vertical pixel number. Each Fourier transform information is Fourier 
transform information on this picture information, is two-dimensional frequency information, and 
is general frequency information as which the information on a phase and amplitude is expressed 
by the matrix form of a pixel number equivalent to picture information. 

[0033] Drawing 5 explains the outline of data processing of the arithmetic circuit 600 in drawing 
4. The image restoration algorithm by the Fourier repeating method is a circulation algorithm by 
repeated calculation. Drawing 5 shows the outline of the circulation algorithm. In the arithmetic 
circuit 600 of drawing 4 , it comprises the means 700 to perform the Fourier transform operation 
shown in drawing 5 , the means 701 to perform reciprocal arithmetic and an addition operation, 
the means 702 to perform the inverse Fourier transform operation, and positive/negative 
judgment and a means 703 to perform an addition addition operation. 

[0034]A means 700 to perform a Fourier transform operation is a means which carries out the 
Fourier transform of the presumed image restoration information in a restoration process, or the 
presumed point response function information used as a degradation factor. Fourier transform 
information can be acquired by carrying out the Fourier transform of each picture information. In 
the outline of data processing of drawing 5 , in order to show the circulation algorithm, the 
operation which carries out the Fourier transform of the information on a dotage picture that it 
is inputted was not illustrated, but by a means 700 to perform a Fourier transform operation, this 
operation is also performed and the arithmetic image storage memory of drawing 4 memorizes. 
[0035]the Fourier transform information on presumed image restoration that the Fourier 
transform of a means 701 to perform reciprocal arithmetic and an addition operation is carried 
out by a means 700 to perform a Fourier transform operation — or, It is a means to carry out 
reciprocal arithmetic of the Fourier transform information on a presumed point response 
function, and to perform an addition (multiplication) operation with the Fourier transform 
information on a dotage picture. A means 701 to perform this reciprocal arithmetic and an 
addition operation processes the deconvolution shown in the formula (3). The Fourier transform 
information on a dotage picture that it is used by processing of a means 701 to perform 
reciprocal arithmetic and an addition operation, The Fourier transformation information on 
presumed image restoration that it was read from the arithmetic image storage memory of 
drawing 4 , and the result of an operation was updated, or the Fourier transform information on a 
presumed point response function is memorized by the arithmetic image storage memory of 
drawing 4 . 

[0036]A means 702 to perform the inverse Fourier transform operation is a means which carries 
out inverse Fourier transform of the Fourier transform information on the presumed image 
restoration calculated by a means 701 to perform reciprocal arithmetic and an addition operation, 
or the Fourier transform information on a presumed point response function. Picture information 
can be obtained by carrying out inverse Fourier transform of each Fourier transform information. 
A means 700 to perform a Fourier transform operation, and a means 702 to perform the inverse 
Fourier transform operation perform processing equivalent as data processing, and it is [ means ] 
usable in the thing same as an arithmetic circuit 

[0037]A means 703 to perform positive/negative judgment and an addition addition operation, 
The arithmetic circuit which is a means to give the non-negative conditions for every pixel of 
each picture information as shown in drawing 3 , and judges the positive/negative of the value of 
each pixel, It comprises an adder circuit which calculates total of the absolute value of the pixel 
of a negative value, an integrating circuit which averages total of the absolute value of the pixel 
of a negative value, and an adder circuit which adds the average of total of the absolute value of 
the pixel of a negative value to the value of the whole pixel. 

[0038]It is contradictory in physical development that a negative value arises to luminous- 
intensity information. Expressing whether luminous-intensity information has a bright picture or it 
is dark, it is contradictory in physical development that a thing like the black hole which absorbs 
energy appears in picture information so that a negative value may be shown. However, the 
picture information which does not have inconsistency as physical development can be obtained 
by giving non-negative conditions by a means 703 to perform positive/negative judgment and an 
addition addition operation. A circulation algorithm functions by sending the result of an 
operation of a means 703 to perform positive/negative judgment and an addition addition 
operation, and the picture information (presumed image restoration information or presumed 
point response function information) obtained to a means 700 to perform a Fourier transform 
operation. In this circulation algorithm, by one circulation, one restoration processing of 
presumed image restoration information or presumed point response function information will be 
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performed, and one repeated calculation of the image restoration processing by the blind 
deconvolution method as shown in drawing 2 will be performed by circulating twice. 
[0039]As for the presumed image restoration information that the result of an operation was 
updated, or presumed point response function information, a means 703 to perform 
positive/negative judgment and an addition addition operation is memorized by the arithmetic 
image storage memory of drawing 4 . Suitably, an output is possible for this updated presumed 
image restoration information to the output (image output part 104 of drawing 1 ) of the image 
restoration of drawing 4 , and an observer can observe it to it Repeated calculation of the 
circulation algorithm of drawing 5 is carried out until the output of this image restoration is 
judged to be enough for an observer. 

[0040]As explained in full detail above, in the digital camera by a 1st embodiment which has an 
image processing function. The sensor which detects a certain physical quantity is made 
unnecessary to amendment factors which are the technical problems of conventional technology, 
such as a shaking hand, by using the deteriorated image restoration technique by the blind 
deconvolution method as an image processing function. Since the mechanism in which the 
amount of Bure is detected automatically is not used, it can amend in accordance with the 
photographic subject image which an operator usually picturizes, and the picture of mistaken 
correction results can be prevented from being recorded on a recording medium. 
[0041 ]In the digital camera which has an image processing function by a 1st embodiment. In 
order to have a recording medium which records both a raw picture and the picture after image 
processing to the picture to photo, when the amount of Bure is automatically measured and 
amended like conventional technology, Since the amendment from which the amendment beyond 
it deviated from the raw picture to the degree very much impossible can be prevented even if it 
is measurement of the imperfect amount of Bure, record of the picture of imperfect correction 
results can be prevented. 

[0042]In the digital camera by a 1 st embodiment which has an image processing function, since it 
has an image processing function by the deteriorated image restoration technique by the blind 
deconvolution method, image restoration processing by computers, such as a personal computer, 
is made unnecessary. Therefore, an output of the good picture which restored the shaking hand 
etc. to the external output unit (un-illustrating), for example, a printer etc., is directly possible by 
using the processing image recording medium 105 as a removable recording medium etc. 
[0043]Next, the composition of the digital camera which has an image processing function of a 
2nd embodiment is explained using drawing 6 . The fundamental composition as a digital camera 
which has an image processing function is the same as a 1st embodiment Different points from 
a 1st embodiment are the point that the alter operation part 400 with a mode change function is 
constituted in a 2nd embodiment to the alter operation part 103 in a 1st embodiment, and a point 
that the point response function recording medium 401 is constituted further. 
[0044]The point response function recording medium 401 comprises a flash memory, a hard disk, 
etc. like recording-medium 101 grade, for example. Record and read-out are possible for this 
point response function recording medium 401 suitably in the point response function used as a 
degradation factor by the blind deconvolution method described by a 1st embodiment obtained 
simultaneously with image restoration in the restoration processing of deteriorated images, such 
as a shaking hand. 

[0045]The alter operation part 400 with a mode change function comprises switches and a touch 
panel like the alter operation part 103 in a 1st embodiment This alter operation part 400 with a 
mode change function has an operating function for making possible suitably record and read-out 
of a point response function at the point response function recording medium 401 together with 
the basic function of the alter operation part 103 in a 1st embodiment 
[0046]The fundamental operation and effect in a 2nd embodiment are the same as a 1 st 
embodiment Different points from a 1 st embodiment are the point that the alter operation part 
400 with a mode change function is constituted instead of the alter operation part 103, and a 
point that the point response function recording medium 401 is constituted further. The 
restoration processing of deteriorated images by the blind deconvolution method, such as a 
shaking hand, is a technique which presumes F in a formula (2), and G and is separated only from 
the information on a deteriorated image as a 1st embodiment described. Therefore, when the 
restoration processing of a deteriorated image is completed, together with the image restoration 
which has not deteriorated, the information on the point response function used as a degradation 
factor can also be acquired. 

[0047]According to a 2nd embodiment, the point response function used as this degradation 
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factor is recorded on the point response function recording medium 401, and when carrying out 
restoration processing of another picture which deteriorated, it becomes possible to shorten the 
convergence processing time by repeated calculation by using positively. That is, restoration 
processing of the deteriorated image by the blind deconvolution method is performed by 
repeated calculation as shown in drawing 2 , for example. Setting [ (for the Fourier transform of 
the point response function with which C becomes the Fourier transform of a deteriorated 
image, F becomes the Fourier transform of an original image, and G becomes a degradation 
factor to be expressed) ] in this repeated calculation, C is known in the deteriorated image 
obtained. [ C=FG of a formula (2), and ] In order to start repeated calculation, the initial value of 
F or G is presumed. Usually, since it is completely strange, F and G use a random number as an 
initial value. Here, an initial value is set to F of a random number, for example. G to this initial 
value is called for from the relation of a formula (2). A non-negative constraint as shown in 
drawing 3 is given to this G, and it is considered as the thing nearer to a correct answer. It asks 
for F from the relation of a formula (2) using G approaching this correct answer. A non-negative 
constraint is given to this F as well as G, and it is considered as the thing nearer to a correct 
answer. By repeating this operation by repeated calculation, F and G approach the correct 
answer. 

[0048]In this repeated calculation, if repeated calculation is started from what has an initial value 
close to a correct answer, convergence time will also be shortened. Then, for example, the 
deteriorated images in the case where shaking hand condition is large, the case of being small, 
etc. are received, When recording the point response function of the result of having performed 
restoration processing on the point response function recording medium 401 and carrying out 
restoration processing of another deteriorated image anew, by the alter operation part 400 with a 
mode change function. Shortening of restoration processing time of a shaking hand is suitably 
attained by choosing the large mode and the small mode. 

[0049]In the digital camera which has an image processing function by a 2nd embodiment. In 
order to make restoration possible to the degradation factor expressed with a formula (1) or a 
formula (2), Restoration processing is possible not only for when a degradation factor is based on 
a shaking hand but degradation according to the focal Japanese quince of a lens for example, 
degradation by the flow of a picture when the photographic subject is moving, degradation by the 
fluctuation of the atmosphere (for example, shimmer etc.), etc. Therefore, it is possible to add 
each mode for every such degradation factor to the alter operation part 400 with a mode change 
function. 

[0050]As for the image processing function in a 2nd embodiment, also in still picture 
preservation of the digital camera of conventional technology, and a digital camcorder, it is a 
matter of course for it to be able to apply. 

[005l]In [ as explained in full detail above ] a 2nd embodiment, Like a 1st embodiment by using 
the deteriorated image restoration technique by the blind deconvolution method as an image 
processing function, In order to have a recording medium which records both a raw picture and 
the picture after image processing and to perform restoration processing to the factor which has 
deteriorated to amendment factors, such as a shaking hand, to the point which makes 
unnecessary the sensor which detects a certain physical quantity, and the picture to photo, the 
deteriorated image restoration technique by the point and the blind deconvolution method for the 
ability to prevent record of the picture of mistaken correction results was used, since the image 
processing function owner is carried out, The image restoration processing by computers, such 
as a personal computer, at the point made unnecessary in addition, the point response function 
used as a degradation factor, The point response function recording medium 401 in which record 
and read-out are possible is provided suitably, When carrying out restoration processing of 
another picture which deteriorated, it has effects, such as a point which makes it possible to 
shorten deteriorated image restoration processing time by providing the alter operation part 400 
with a mode change function which makes selectable what was suitable from this point response 
function currently recorded. 
[0052] 

[Effect of the Invention]As mentioned above, as explained in detail, when the deteriorated image 
restoration technique by the blind deconvolution method is used for this invention as an image 
processing function, It is possible to provide the digital camera which has an image processing 
function which can make unnecessary the sensor which detects a certain physical quantity to 
amendment factors, such as a shaking hand, and can acquire a good picture with easy 
composition. Since the mechanism in which the amount of Bure is detected automatically is not 
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used, it can amend in accordance with the photographic subject image which an operator usually 
picturizes, and the picture of mistaken correction results can be prevented from being recorded 
on a recording medium. 

[Translation done.] 



http://www4. ipdl. inpit go j p/cgi -bin/tran_web_cgi_ejj e?atw_u=http%3 A%2F%2Fww. . . 2009/04/02 



JP,2001-333326,A pESCRIPTION OF DRAWINGS] 



2001-333326 



* NOTICES * 

JPO and INPIT are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 

[Brief Description of the Drawings] 

[Drawing 1] It is a lineblock diagram of the digital camera which has an image processing function 
concerning a 1 st embodiment of this invention. 

[Drawing 2] It is a figure showing the image restoration algorithm by the Fourier repeating method 
which is the contents of the image processing function concerning an embodiment of the 
invention. 

[Drawing 3] It is a model figure of non-negative conditions of the image restoration algorithm by 
the Fourier repeating method. 

[Drawing 4] It is a lineblock diagram of the image-processing-arithmetic circuit concerning an 
embodiment of the invention. 

[Drawing 5] It is a schematic diagram of data processing of the image-processing-arithmetic 
circuit concerning an embodiment of the invention. 

[Drawing 6] It is a lineblock diagram of the digital camera which has an image processing function 
concerning a 2nd embodiment of this invention. 

[Drawing 7] It is an outline lineblock diagram of the technique of amending degradation of the 
picture by the shaking hand in the conventional digital camera, etc. 
[Description of Notations] 

101 Storage (memory storage) 

102 Picture information arithmetic circuit (image processing means) 

103 Alter operation part (control means) 

104 Image output part (display) 



[Translation done.] 



http://www4. ipdl.inpit.go.jp/cgi-biiT/tran_web_cgi_ejj e?atw_u=http%3 A%2F%2Fww. . . 2009/04/02 







S5 «j 




KJ 




as 






.y 






-R 




+j 






© 




to 


V 






«f $ 




H 


TO 








V 40 


G 




AJ 




o 












w 






w 2 






vf 


•IN 










1 J 


5 


S 


AJ 




_i 


f 




fp 






^ ii 






K> 


H 






4 Si 




se 


K> 




iS 


Ij 












1 




G 5 








G 


« 






I 






»0 




SB 








e 










« 


45 








G 


^ 




S 












IS 














t* 






% it 








mi 






■n 


















IN 


? 








@ 


■R 


G 


I 








i 














A 


*j 






w 3 


* 




-£* 

sb 

<a( 




^ 


<& 








»0 40 






<n § 






■R. 








*s £ 

■y s» 


83 






G 


s 




J4 








J 




& @ 














IJ 


!N 


Eg 


K> 










ft 




■t* G 




5 




*> 










ft 


0 


IK 


« 








g 






y) 






S 










Hj H 


K 


u 


*Q 












* 




B 




1 S 






IK 








. G 


& 


SI 




t 




s 




G 






& 






■K 










-> « 


■H 




-J 










•c 


AJ 








SIS 




AJ 




* 


H 




S8 


a 




AJ 










*i 


m 




u 


IP 








»r\ 






ft 






s 




n 






It 








i 




G 




G , 




■4 






W 


AJ 






G 




i 












ij 




» 












G 


& 




s u 


I 








I 




-rtJ 








i 














G 


! 


G 










AJ 






JK 


o 


A 










in 




G 


I . 


» 






to 








e 






» 




A 








O 




-H 








i 4p 


o 




¥ 




m 




o 














^ s> . 


o 




a 








o 






»o 


*i 




o 








TK 






N 4 Kl 


o 






» 3 






If 


. o 






*j 


AJ 


l 


. o 


§ 






4> 




a 


~ ii * 




AJ 


O 














»J 




o — 






s 


_> 






2 



<4 



a. 



* ^ N CS O) 

<i W Ifi N lO 

^ o o o o 

f X CQ O O 

r» oi »ra in in 




i 

i 



a g g s g 

to 2 *" m " 

H 2 CQ H 2 2 

-<r co «> rr xr 

Ji o o o o o 

O X O O 2 X 




as 

s 



S3 

§ 

m 

DC 








IK 




G 


« 








S 






s 




s 








A 


5 










g e 






1 














AJ 




1 


8 








I 




S! 


i 


« 


m 






I 






-L. 








A 




1 


»J 


K> 










t 




I 






A 










1 


n I 


^ 


OK 


% 




« 


V 






s 


•C^ 




S§ 










s 










1 












g ® 




G 




« 




IN 










* 




»J 






1 




VH 


* a 
















J* 
















g 


*> 






a 


-H 




& 


a 














In 


AJ 






i 




CM 


















A 


& 


S 


V 




«K 


B 


§ 


O 








A 


?\ 


»J 














i 


g 




i 




01 






A 


s 


»o 


•o 






AJ 


IS 


n 


IK 


»t> 








I 






G 






















•s 


a 


o 


K 


IK 




It 




« 












a 

H 












I 


»0 






3 


»J 




i 






>o 
































■H 


V 






B 


i 










J5 


i 


« 




» 








t 




a 
















ij 


1K 












e aj 














114 








i J 


»J 


m 




£ 


* 


+-> 


a 


.\ 




I 


S 




i 








a o> 


S 


r«3 




g 


« 


i 






V G 


H 


G 






J 






G 


n 




A 


4 






I 




a « 


H 


In 




TV. 




e 


t* 


« 


5* 


G 




s 






a- 




s» 


TK 




m 




i 










s& « 








ii 




o 


AJ 




« U 


IN 


■0 


*» 






i 


AJ 






K> 




A 






"h 


? 






g H 




IK 


« 


»J 


% 




ft 




ii _j 






g: 


4« 








i 


^. 


■4 


_> 










r\ 






* ^ 


!\ 






•V 








K 


JS ^ 


■R 


P 


& 








A 






ii 






•p. 






Q 


1 


8 


, 1 


S 








*k! 




s 


s 


N ^ 


Q 






-3 




o 


01 




O 












! 












« 






J* 




»^ 


IK 


O 




AJ 






A 




e 






A 












a 


& G 








to 




a; 




G 


« *> 


O 


i 




G 




(C 






*) 






n 




_> 














H 










LT> 


60 


G * 






a 






K» 


1 


N 




« 




IS 








CM 






!i 










00 




<M 




V S 




a 










O 








X 






O 




i 




8 


T 




IK 






O 














A 


O 


s 


J 


S3 


A 








o 




















o 


i 






<\ 










n 






3 


V 














1 




g 


IK 

















J4 N X 

4 





G 

-:s 



S t 



AJ 



S5 

G 

a 




a 

B 



G 



~ D 



O 

\ 

1~ 5 



^ < --5 a 
« 



: I i 



— *J — _> -R 

« P « «j ~j 

— % _ u - 

o aj ^ Si o* 

CM » J M jfij CNJ 

O V O ^ O 

o * o H o 

— AJ - ^ — 



s a fc . 



CM Cm 



3 




+-4 




4? 


AJ 


0 


-<* 


id 








AJ {d 




IS" 




AJ 








#1 




K) 


M 


AJ 






££ 


@ 


ii 




G 


5 s 






IS 












-si 


*j 


AJ 


»J 




s§ 


8 


AJ 


IB 




m eei 






K" . o 




I? 






s 


™ 




f> 


I j 






Si 


1 




Eft 








m _> 




► j' 














\H* ^ 




o 






g 






i±j 








,\, J^c 


ill 


G 




AJ 






! 


i 




AJ 


-U 












g 




w s 




i $s 




-iP 


o 










4 


V- 




5 








H 


ij 






SI V 






fch jj* 


^, 


*l 


o 


K» 










-H 33 






I 5 * 








» 










38 t» 
^ S & 














-H 




ii 


$ 




BP 














© AJ 








IS 




to 






^J 


n 




















\ 


AJ 




n 


® S 






I 












u « 


St 














j^j 




ft 


It 1 


K> *0 tti 














X 














jj 


j 


* 


K> 


HI 


85 




■4 -S# S 






-R 










A 


s ^ 




A^ 


^» 

s 




■s 




A 




V- 


G 


ft 




12 A) |S 


G 












u 




^ G 








< J 


A) 




H 


33 




V 


S H ^ 


m 




$ 


1 






s 


















H 
















S 








^ 




P 




Ij 








n 


AJ 










it ^ -t* 

G ^ S 


*> 












•H 










*p 














& 1 








I 






fc 








ss 




as 






I 


X 










M iK 


» , I-" 


AJ 






1 








j> 








@ 




is 




\ 


1 










.\ V J 






X 


I 








AJ 


IS 














>r 


f 






*. a 


n «^ 33 


G 




1 


















AJ 




£ 


IN 




■R 


i£ 






^ ^ * 


P 








Csl 




i 


aj e 

* m 




I 


s 


u 


U5 






f 






















m 


G 




J 






g 


O 










G 




-rtj 


V 




o 








AJ 








o 


P 




iR 


J 


I.S 










AJ 


AJ 




o 










& 


■R 






—5 






iff H 




m 




V 




1 


ii G 




B 




p *J « 

« ti: *J 
W « 8 





CM 

m 
m 
m 



o 




s 















H 








g 

H 

1 













o c 







«5 
H 






1 




i 










l\ 


■ 

c 


4 


■A 


3 

R 


5 




H 


a 

s 




SI 




a 




